BIRKHOFF'S THEOREM AND MULTIDIMENSIONAL 
NUMERICAL RANGE 



YU. SAFAROV 

Abstract. We show that, under certain conditions, BirkhofT's theorem 
on doubly stochastic matrices remains vahd for countable families of dis- 
crete probability spaces which have nonempty intersections. Using this 
result, we study the relation between the spectrum of a self-adjoint oper- 
ator A and its multidimensional numerical range. It turns out that the 
multidimensional numerical range is a convex set whose extreme points 
are sequences of eigenvalues of the operator A . Every collection of eigen- 
values which can be obtained by the Rayleigh-Ritz formula generates an 
extreme point of the multidimensional numerical range. However, it may 
also have other extreme points. 



Recall that a (possibly infinite) matrix is said to be doubly stochastic if 
all its entries are non-negative and the sum of entries in every row and every 
column is equal to one. Birkhoff 's theorem ^ says that 

(i) the extreme points of the convex set of doubly stochastic matrices are 
permutation matrices and 

(ii) the set of doubly stochastic matrices coincides with the closed convex 
hull of the set of permutation matrices. 

The first aim of this paper is to show that, under certain conditions, Birkhoff 's 
theorem remains valid for a countable family of discrete probability spaces 
which have nonempty intersections (see Remark 12. ip . We join every two 
points lying in the same probability space by an edge and reformulate the 
problem in terms of weighted graphs. It turns out that (i) and (ii) hold true 
whenever the underlying graph satisfies the conditions (gi)-(g3) introduced 
in Section 2. The conditions (gi) and (ga) are purely technical and can 
probably be removed or weakened. The geometric condition (g2) is necessary 
(see Remark [2. 5|) . 

The second aim of the paper is to study the relation between the spec- 
trum of a self-adjoint operator A and its m-dimensional numerical range 
S(m, A) . The latter is defined as the set of all m-dimensional vectors of the 
form QA[^i2]5 • • •} 5 where Qa is the corresponding quadratic form, 

{ui, U2, ■ ■ ■} C 'D{Qa) is an arbitrary orthonormal set containing m elements 
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and m = l,2,...,oo. Using an infinite dimensional version of Birklioff 's tlie- 
orem, we prove tliat 

(1) tlie m-dimensional numerical range S(m, A) is a convex set, 

(2) the extreme points of T,{m,A) belong to the corresponding m-dimen- 
sional point spectrum ap{m, A) , 

(3) every collection of m lowest or highest eigenvalues which can be found 
with the use of the Rayleigh-Ritz formula generates an extreme point 
of E(m, A) , 

(4) the extreme points of the closure S(m, A) belong to the m-dimen- 
sional spectrum a{m, A) , 

(5) the closed convex hull of a{m,A) coincides with E(m, A) 

(see Section 4 for precise statements and definitions). The item (3) can be 
regarded as a geometric version of the variational principle. The set S(m, A) 
may also have other extreme points (see Remark I4.12|) . Therefore one can 
obtain more information about the point spectrum by studying the extreme 
points of S(m, A) than by applying the standard variational formulae. 

The paper is organised as follows. For the sake of convenience, in Section 1 
we give definitions and results on sequence spaces and locally convex topolo- 
gies, which are used throughout other sections. Almost all these results are 
well known; most of them can be found in |Kj, Sections 20.9, 21.2, 30 and 
(Ruj, Section 2.4. 

Section 2 is devoted to Birkhoff's theorem. Many proofs of this theorem 
are known for finite matrices (see, for example, |MUj or (BP] ). The problem 
of extending (i) and (ii) to infinite matrices is known as Birkhoff's problem 
111. It has been studied in [Hrj, jTs], [Kil, lEi, M and [EEl- However, 
their results are not sufficient for our purposes because 

(i) in order to deal with unbounded operators, we need (i) not only for 
the whole set of stochastic matrices but also for some its subsets which 
were not considered in these papers, 

(ii) we need (ii) with respect to a finer topology than the topology intro- 
duced in |Kej or |RPj . whereas [Ts| deals with a too strong topology 
such that (ii) does not hold true. 

Our proof of (i) and (ii) is based on the well known idea of shifting weights 
along edges of the underlying graph. It is almost purely combinatorial and 
works equally well for finite and infinite weighted graphs or matrices. For- 
mally speaking, in Sections 3 and 4 we consider only infinite matrices. How- 
ever, in the proof of Theorem 13.151 we apply results related to more general 
weighted graphs. For infinite graphs and matrices (ii) depends upon the 
choice of an appropriate topology. We give an exphcit description of the 
strong and Mackey topologies on the set of (sub) stochastic weights (Corollar- 
ies and 5 and show that (ii) holds true with respect to the Mackey 
topology f Theorem l2.15|) . but not necessarily with respect to the strong topol- 
ogy f Example I2.19|) . 
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In Section 3 we consider operators generated by stochastic matrices and 
derive a number of corollaries from Birkhoff 's theorem. Many of these results 
seem almost obvious. However, our proofs of the key Theorems l3.1Ul and l3.15l 
are surprisingly long and complicated. It is not clear whether they can be 
essentially simplified. 

Section 4 is about multidimensional spectra and numerical ranges. Here 
we give precise statements and proofs of (l)-(5) for a self-adjoint operator 
A (see Corollaries 14 . 7^ E . 1 II and Lemma f4.10|l . The corresponding results for 
finite matrices A are well known and rather elementary (see, for example, 
|XTT] or (MOD- If A is compact, one can probably obtain (l)-(5) by con- 
sidering its finite dimensional approximations (in |Malj and [HIl similar ideas 
have been used for studying s-numbers of compact operators). However, the 
general case is much more complex as the operator A may have continuous 
spectrum or (and) several accumulation points of its discrete spectrum, which 
makes it impossible to find an effective approximation procedure. In the end 
of Section 4 we prove two variational formulae (Corollaries 14.161 and I4.17j) 
and show that cr(m. A) is a subset of the closed convex hull of IJ^ a{m, Aq) 
whenever the self-adjoint operator A belongs to the closed convex hull of 
the family of self-adjoint operators Ag fCoroUarv 14.211) : all these results are 
simple consequences of (l)-(5). 

There are many other concepts of multidimensional numerical range |BDj . 
[Hj . |LMMTj . We briefly discuss some of them in Subsection 14.11 

Acknowledgements. I would like to thank E.B. Davies, A. Markus, Yu. 
Netrusov and M. Solomyak for their valuable comments and constructive 
criticism. I am also grateful to L. Landau for his useful remarks on Birkhoff 's 
theorem. 

1. Sequence spaces 

1.1. Notation and definitions. Let 

M := [-00, +oo] , 

M°° be the linear spaces of all real sequences x = {xi,X2, ■ ■ ■} , 
M."^ be the subspace of sequences which converge to zero and 

be the subspace of sequences with finitely many nonzero entries. 

We shall often consider the Euclidean space M™ as a finite dimensional sub- 
space of , so that the m-dimensional real vector {xi,X2, ■ ■ ■ , Xm) is iden- 
tified with the sequence (xi, X2, . . . , Xm, 0, 0, . . .) . If x G M°° , let 

|x| := |X2|, . . .} , 

(1.1) x(™) := {xi,X2,...,Xm,0,0,...}, m = l,2,..., 

x(°°) := X. 

Throughout the paper X denotes a real linear subspace of M°° endowed 
with a locally convex topology T and X* is its dual space. We shall always be 
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assuming that X is finer (that is, not weaker) than the topology of element- 
wise convergence. 

If f2 is a subset of X then ex f2 , conv Vl , conv VL denote the set of extreme 
points of n , the convex hull of Q and its T-closure respectively. Recall that 
X e Q is called an extreme point of if x cannot be represented as a convex 
linear combination of two other elements of Q . If the set Q is T-compact 
then, according to the Krein-Milman theorem, conv fl = conv (ex Q) . An 
element x e f2 is said to be l-exposed if there exists a linear T-continuous 
functional x* e X* such that (x, x*) > (y, x*) for all y e Q . Every exposed 
point of Q belongs to exJl but an extreme point is not necessarily exposed. 

Denote by X' the linear space of all real sequences x' = {x[, X2, . . .} G M°° 
such that X^^i < 00 for all x e X . If X" = X then the space X is 

said to be perfect. We have X C X" and Rgg Q X' — X'" ; in particular, 
X' is perfect. The intersection of an arbitrary collection of perfect spaces is 
perfect. However, the linear span of a collection of perfect spaces may not 
be perfect. For example, if X is a one dimensional subspace of then 
X" C but (Mg°)" = . 

The set of sequences x = {xi, X2, ■ ■ ■} such that \xj\ < \xj \ for some x e Q 
is said to be the normal cover of the set Q, . A set (or subspace) of M.°° is 
said to be normal if it coincides with its normal cover. Wc have X' = [X)' , 
where X is a normal cover of X . Therefore a perfect space is normal. 

1.2. Topologies on sequence spaces. Every sequence x' e X' defines 
the linear functional (x, x') Xljli '^i ^^'j space X . Further on we 

shall always be assuming that C X . Then every nonzero element of 
X' defines a nonzero functional and therefore we can introduce the weak* 
topology %T„{X',X) on X' . If © is an arbitrary family of weak* bounded 
sets Q' e X' then the family of seminorms 

(1.2) pa'(x) := sup |(x,x')|, f^' G 6 , 

defines a locally convex topology on the space X , which is usually called the 
6-topology. We shall deal with the following 6-topologies on X : 

(1) the topology of element- wise convergence To , generated by the family 

& of all finite subsets of ; 

(2) the weak topology 'Xy^{X, X') , generated by the family & of all finite 
subsets of X' ; 

(3) the Mackey topology %ni{X, X') , generated by the family & of all 

absolutely convex 'Xw(X', X)-compact subsets of X' ; 

(4) the strong topology Tb(X, X'), generated by the family & of all 
Tw(X', Ar)-bounded subsets of X' . 

Every next topology in this list is finer than the previous one. Each of 
them is equivalent to the usual Euclidean topology whenever dimX < 00. 
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The strong topology Tb(X, X') is generated by all lower 'X„(X, X')-semi- 
continuous seminorms on X and the Mackey topology 1^{X,X') is defined 
by all lower Tw(X, X')-semicontinuous seminorms p on X such that 

(1.3) p(x-x(™)) 0, VxgX. 

The perfect space X" is obtained from X by adding all To-limits of 
Tw(X, X')-Cauchy sequences in X . A perfect space X is Tb(X, X')-comp- 
lete, 'Xm(X, X')-complete and sequentially Tw(X, X')-complete but is not 
necessarily ^^^(X, X')-complete. By the Mackey- Arens theorem, %^{X,X') 
is the finest locally convex topology on the space X such that its topolog- 
ical dual X* coincides with X'. If X' is Tw(X', X)-complete then the 
Tb(X, X')-dual of X also coincides with X'. 

By Mackey's theorem, a subset of a locally convex space is weakly bounded 
if and only if it is bounded in any topology generating the same dual space. 
For a sequence space X , we have the following stronger result which implies 
that C X is Tw(X, X')-bounded if and only if it is Tb(X, X')-bounded. 

Theorem 1.1. Assume that C X is %^{X, X') -bounded and Vl' C X' 
is X„(X', X) -bounded. Then the set of sequences {xi x[ , X2 x'2 , . . .} , where 
X = {xi,X2, . . .} G and x' = {x[,x'2, . . .} E Q' , is bounded in . 

Proof. See |Ru|, Chapter 2, Proposition 1.4. □ 

The following theorem can be proved in the same way as Theorem 2.4 in 
|Ruj . Chapter 2, where the author assumed that X is perfect. 

Theorem 1.2. If X is a normal space and VL' C X' then the following two 
conditions are equivalent: 

(1) VL' is %^{X' , X)- compact, 

00 

(2) Q' is l^-compact and lim sup ^ l^ix'^l =0 for each x G X . 

Remark 1.3. If {x„} C X is a Tw(X, X')-Cauchy sequence which converges 
to X G X" in the topology To , then by Fatou's lemma 

sup |(x,x')| < sup (|x|, |x'|) < sup sup(|x„|, |x'|) . 
x'ef^' x'en' x'gH' n 

Since the Cauchy sequence {x„} is %„,(X. XO-bounded. Theorem II. H and the 
above inequality imply that the set fl' C X' is Xw(X', X")-bounded if and 
only if it is T„(X', X)-bounded. Therefore the strong topology Xb(X, X') 
coincides with the restriction of Tb(X",X') to X. However, this is not 
necessarily the case with the Mackey topologies. 

Example 1.4. If X = R[j° then X' = l\ X" = l°° and Tb(/°°,/^) is the 
/"^-topology. Theorem 11.21 implies that the closed unit ball in the space 
is Xw(/\M[j°)-compact. Therefore TmlKIT'^^) = '^h{l°° , l^)\uc. . The Mackey 
topology Xm(Z°°,Z^) on is strictly coarser than Tm(R[f,Z^). Indeed, if 
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X = {1, 1, . . .} and x^ := x^'^+i) - x^*") then x„ G , \\±m\\i°° = 1 but, 
by Theorem 11.21 x^ ^0 as m ^ oo in the topology l^) . 

Remark 1.5. Let Q' be the normal cover of the set Q' G X' . Theorem 11.11 
implies that Q' is Tw(-^', -^)-bounded whenever fl' is ^rw(-^', X)-bounded. 
If X is normal then, by Theorem 11.21 ^' is Twl-^'? -^)-compact whenever 
fl' is Tw(-^', -^)-compact. Obviously, 

oo 

Pn'i^) = sup |(x,x')| < sup |(x,x')| = sup \x'j\ = p^,{x) 

x'ef^' x'gQ' x'gH' 

and the seminorms p^, are lower To-semicontinuous. Therefore the strong 
topology Tb(X, X') on an arbitrary space X is generated by all lower To- 
semicontinuous seminorms and the Mackey topology %^{X, X') on a normal 
space X is generated by all lower To-semicontinuous seminorms satisfying 

dH. 

1.3. Symmetric sequence spaces. Our choice of notation in the following 
definition will become clear in Section 3. 

Definition 1.6. If x G M~ , let 

Px be the set of all sequences y G obtained from the sequence x 
by permutations of its entries, 

be the set of all sequences y G ]R°° whose entries form a subse- 
quence of a sequence y G Px and 

P^ be the set of all sequences obtained from sequences y G P^ by 
adding an arbitrary collection of zero entries. 

We shall say that a sequence space X is symmetric if Px C X for every 
X G X . A seminorm p on a symmetric space X is said to be symmetric if 
p(y) = p(x) whenever y G Px . 

If X is symmetric then P^, C X' for every x' G X' . The seminorm pqi 
defined by ()1.2|) is symmetric if and only if Q' = IJx'en' ■ '^^^ following 
result is a consequence of Theorems 1 1 . 1 1 and 1 1 . 21 f see Remark 13. 2j) . 

Corollary 1.7. Let X be a symmetric space such that X ^ Rj^ , Q' be a 

subset of X' and fi^^^ := Ux'ef^' ^x' ■ U X C then fi^^^ zs Tw(X',X)- 
bounded whenever Q' is %„{X' , X) -bounded. If X ^ and X is normal 
then figyjn is %^{X' , X) -compact whenever Q! is %^{X' , X) -compact. 

By Corollary ITTl if X is a symmetric subspace of l°° and X ^ 
then the strong topology Tb(X, X') is generated by a family of symmetric 
To-semicontinuous seminorms p such that 

(1.4) p(y)<p(x), VyGXf|P^ Vx G X . 

If X is a normal symmetric subspace of R[f and X ^ then the Mackey 
topology Tin(X, X') is generated by a family of symmetric To-semicontinuous 
seminorms p satisfying (jl.3|) and (jl.4|) . 
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Example 1.8. If X = R°° then X' = Mgg and To = 2:m(M°°,M§S) = 
Xb(M°°,R[]^) . This topology cannot be defined with the use of symmetric 
seminorms. li X = F with 1 < p < oo then X' = P and Tb(/^,/^) 
is the usual /^'-topology. If p < oo then Xb(/^,/^') = Tm(/^,/^'), but the 
Mackey topology is strictly coarser than the Z°°-topology and is 

not generated by a family of symmetric seminorms. 

Example 1.9. Let $ be a symmetric lower To-semicontinuous Schatten 
norm on and s^'* C s$ C be the corresponding linear subspaces of 
sequences (see, for example, jBIl or |Malj : in the latter paper $ is called a 
symmetric gauge function and the corresponding subspaces are denoted by 
Z$ and l^^ ). Then the norm topology on a subspace X C s$ is always 
coarser than Tb(X, X') and is coarser than Tm(X, X') whenever X C s^'* . 

Example 1.10. Let x G M[f , x ^ and X be the subspace spanned by the 
normal cover Px of the set . Then X' consists of all sequences x' e 
such that 

(1.5) ||x'||l := sup |(y,x')| < oo . 

yePx 

The space X' provided with the norm ()1.5|) is called the Lorentz space asso- 
ciated with the weight sequence x (see, for example, |LTj . Section 4.e). We 
have 

oo oo m 

(1-6) El^^-ll^^-l* = E(l<l*-|^™+il*)El^^-|' Vx',yGM-, 

k=l m=l j=l 

where |2;2|* . . .} denotes either the non- increasing rearrangement of 

the sequence |z| or (if |z| contains infinitely many nonzero entries and at 
least one zero entry) the non- increasing rearrangement of its nonzero entries. 
Using this identity, one can easily show that y G X" if and only if 

(1.7) ||y|U/ := sup i?^(|y|) (i?™(|x|))-i = sup |(y,x')| < oo , 

m>l ||x'||£,<l 

where Rm{\z\) := Xljli kjl*- The space X" provided with the norm ()1.7j) 
is called the Marcinkiewicz space associated with x . Since the set Px is 
Tw(X, X')-bounded, Theorem 11.11 implies that the Tw(X', X)-bounded set 
{x' G X' : ||x'||l < 1} absorbs any other Tw(X', X)-bounded subset of 
X' . Therefore, in view of R,emark the strong topology Tb(X",X') is 
generated by the norm || ■ \\m ■ The Mackey topology Tm(X",X') is strictly 
coarser than Tb(X",X') as ||y — y^™-*!!!/ may be equal to ||y||A/ for all m . 

Remark 1.11. Let Xp^ be the linear space spanned by Px . Then Xp^ is the 
minimal symmetric perfect space which contains x . Obviously, 

(1) if X is unbounded then X'p^ = Mg^ and X'^^ = R°° ; 

(2) if X G but X ^ then X'p^ = and X^^ = /~ ; 
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(3) if X G but ^ then X'p^ is the Lorentz space and Xp^ is the 
Marcinkiewicz space associated with x (see Example II .lOj) : 

(4) if X G but X ^ Mgg then X'p^ = and X'^^ = ; 

(5) if X G M§S then X'p^ = M°° and X^^ = KgS • 

Remark 1.12. If x ^ Mgg and C X then X' C and C X" . 
Therefore for every Xb(X, X')-continuous seminorm p on X there exists a 
constant Cp such that p(x) < Cp ||x||;i for all x G Xf]/^ . 



2. Birkhoff's theorem 

2.1. Notation and definitions. Let G = {Gi,G2, ■ ■ ■} be a family of 
countable sets Gk which may have non-empty intersections. Define a simple 
graph G as follows: the set of vertices of G coincides with IJ^, Gk and two 
vertices are joined by an edge in G if and only if they belong to the same set 
Gk- Then Gk become complete subgraphs of G. Throughout this section we 
denote by g (with or without indices) the vertices of G or, in other words, 
the elements of [Jk^k- Let 

W be the linear space of real- valued functions w on G , 

VV+ be the cone of non-negative functions w G W and 

Wo be the set of functions w G W which take only finitely many 

non-zero values. 

We shall call w G W+ weights over G and denote by w{g) the weight 
assigned to g & G (that is, the value of w at (7). If w G W , let 

Gw be the subgraph of G which includes all vertices g E G such that 
w((yf) 7^ and all edges joining these vertices. 

Let Gi be an arbitrary subset of G. We shall say that a weight w G VV+ is 
Gi-stochastic if J2geGk ^(d) — ^ ^'^^ every G G and J2geGk ^(d) ~ ^ ^'^^ 
every G Gi . Denote by the convex set of all Gi-stochastic weights 
and let be the set of Gi-stochastic weights taking only the values 

and 1. Clearly, w G if and only if the restriction of w to every subset 
Gk takes at most one value 1, all other values being 0, and w does take the 
value 1 at some vertex g E Gk whenever Gk G Gi. If Gi C G'l C G then 

pG[ ^ pGi ^ ^Gi ^ ^Gi _ 

Remark 2.1. The weights w G 5*^ and w G 5^ are said to be stochastic 
and, respectively, sub-stochastic. A stochastic weight w can be considered 
as a family of probability measures W(fc) := w|(^^ on the sets Gk such that 
W(fc) = W(j) on GkClGj- 

Since the set of vertices is countable, W can be identified with the sequence 
space M.°° (or with its subspace if G is finite) . Further on we use definitions 
and notation introduced in Section 1. 
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2.2. Extreme points. We shall say that a path go ^ gi ^ ■■■ ^ gi in G is 

admissible if no three adjacent vertices in this path belong to the same 

set Gfc G G ; 

a cycle if go = gi and the number of distinct vertices gj is not smaller 
than 3 (that is, go ^ gi ^ g2 = do is not a cycle). 

Proposition 2.2. Every two vertices lying in the same connected corn,ponent 
of G can he joined by an admissible path. If there are no admissible cycles 
and, in addition, 

(ci) the intersection Gkf]Gi of two distinct sets Gk,Gi e G contains at 

most one vertex of G 

then this admissible path is unique. 

Proof. Let go and g^ belong to the same connected component of G . Then 
a path go ^ Qi ^ ■ ■ ■ ^ Qm with the minimal possible number of vertices is 
admissible (otherwise we could obtain a shorter path from go to gm replacing 
gj gj+i ■ ■ ■ ^ gjj^i with gj gj+i)- This proves the first statement. 

Let gi gi ^ ■ ■ ■ ^ gm and gi gn+m ^ ■■■ ^ g^+i gm be two 
distinct admissible paths from gi to gm ■ Without loss of generality we may 
assume that these paths have only two common vertices gi and gm ■ Then 
the vertices gi, . . . , gm+n are distinct and do not belong to the same set G^ . 
Consider the graph Q formed by all these vertices and all joining them edges. 
Let g\ ^ g2 ^ ■ ■ ■ ^ Qi+i = 9i be a cycle in Q with the minimal possible 
number of vertices which do not belong to the same set Gk (since Q contains 
at least one cycle gi ^ g2 ^ ■ ■ ■ ^ gm+n with this property, such a 'minimal' 
cycle exists). The condition (ci) imphes that this cycle is admissible. Indeed, 
if two non-adjacent vertices gi and gi-^j in this path are joined by an edge 
then all vertices of the cycle gi ^j+i ^ g^^j g^ belong to some 

set Gfe e G and all vertices of the cycle gi+j — > gi+j+i —>■■■■ ^ gi ^ gi ^ 
' ' ' ^ 9i ^ Qi+j belong to a distinct set Gi , in which case the intersection 
Gk n Gi contains at least two elements gi and ^j+j . This proves the second 
statement. □ 

Further on we shall be assuming that 

(gi) every vertex of G belongs to at most two sets Gk, 

(§2) every admissible cycle in G has an even number of vertices. 

If the conditions (gi) and (g2) arc fulfilled then G can be split into two 
groups G+ = G2 ) • • •} and G~ = {G]^, G2 , . . .} in such a way that any 
two sets from the same group do not have common elements (two sets Gk 
and Gj belong to the same group if every admissible path Gk 3 go ^ 9i ^ 

■ ■ ■ ^ gi-i ^ gi E Gj in G with gi ^ Gk and gi_i ^ Gj has an even number 
of vertices). The intersection G'l ^G~ may consist of several elements or be 

empty, and every set may contain a 'tail' subset which does not have 
common elements with any other set Gj. 
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In view of the following example, all results of this section are valid for 
finite and infinite matrices which we shall discuss in more detail in Section 3. 

Example 2.3. Let G satisfy (gi) and (g2) and G"*^ be defined as above. 
Denote by m± the number of sets lying in G^ ; we allow m_|_ = oo and 
(or) m_ = cx) . If every intersection f] Gj consists of one element and all 
the tail subsets G^ are empty then W is isomorphic to the linear space of 
m+ X m_-matrices. Indeed, the value of w G W at the vertex g G G^ f] Gj 
can be considered as the entry of an m_|_ x m_-matrix at the intersection of 
its jth row and fcth column. In this case , S'^ and are the sets of 
doubly stochastic, sub-stochastic and permutation matrices respectively. 

If G is a general family of sets satisfying (gi) and (g2) then one can think 
of W as a space of matrices which may have 'multiple' or 'forbidden' entries 
and 'tails' Gf attached to their rows and columns. 

Theorem 2.4. Let the conditions (gi) and (g2) be fulfilled and let V be a 
normal conic subset of W. Then ex {S^^ f]^) = fl ^ ■ 

Proof. Obviously, f]V G ex {S^^ fl "^') • order to prove the converse, 
let us consider a weight w G f] V such that "w{g') G (0, 1) for some g' G 
G and show that w ^ ex {S^^ f] V) . Let G' be the connected component of 
Gw containing the vertex g' . Then w{g) G (0, 1) at every vertex g E G' . 

(1) Assume that, for some k I , the intersection G' f]Gkf]Gi contains 
two distinct vertices gi and g2 ■ Let wf{gj) = w{gj)±{—iye and "wf{g) = 
w{g) whenever g ^ gj , j = 1,2 . Then w = ^(w+ + w^) and, in view of 
(gi), G (S^if^V provided that £ > is sufficiently small. Therefore 
without loss of generality we can assume that G' satisfies (ci). 

(2) Similarly, if G' contains an admissible cycle Q = go ^ 92 ^ ■ ■ ■ ^ 
gn = 9o, let wf{gj) = w{gj) ± (-1)% and wf{g) = w{g) whenever g . 
The condition (g2) implies that w+ and w~ are correctly defined weights 
over G . We have w = |(w+ + w~) and G W+Pj'^' provided that e 
is sufficiently small. In view of (gi), if gj G Gk then one of the adjacent 
vertices gj-i,gj+i belongs to Gk and the other does not. This implies that 
EgeGfe (^) = EgeGfc w(^) for every k . Therefore G fj "1^ • 

(3) Finally, let us assume that G' does not contain admissible cycles and 
satisfies (ci). Then, by Proposition \'2.'2\ every two vertices go,gi G G' are 
joined by a unique admissible path. Let us fix go G G' and denote by Qn the 
set of vertices in G' obtained from go by moving along all admissible paths 
with n edges. Then for each k = 1,2,... there exists n > such that Gk ^ 
Gn U Gn+i ■ Moreover, if Gk C Qn[J Qn+i then the intersection Gk fl Gn 
consists of one element gk^n ■ Indeed, if there are two distinct admissible paths 
90 91 ■■■ ^ 9k,n and 9o ^ 9'i ^ ' ' ' ^ 9k,n ^ GkClGn then go and 
gk^n can be joined by the two distinct admissible paths go ^ 9i ^ ■ ■ ■ ^ 9k,n 
and 90^ 9'i^ ' 9k,n ^ 9k,n ■ 
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If go E Gk then Gfc C U 9k,o = 9o ■ Let us denote 

(2.1) £fc,o := mm <^ - , — — > , £:fc,„+i :^ 



2 ' 2w(5(o) J ' ' ■ 1 - w(5ffc,„) ' 

where n = 0, 1, 2, . . . and k is such that Gk Gn[j Qn+i ■ Since w G 
we have w{gk^n) + ^{gk,n+i) < 1 and, consequently, 

w(5'fc,n) ^ 1 - w{gk,n+i) 



1 - w{gk,n) w{gk,n+i) 
Using these inequahties, one can easily prove by induction in n that 

(2.2) efc,n < mm 



2' 2w{gk,n) 

Consider two sequences of weights w+„ and w~„ such that 

wjo(fl'o) := (1 ± £k,o) w(5fo) and wJo(5() := w{g) for all 5^ 7^ 5-0 , 

^tn+lia) ■■= ^tnia) for all g G UjXn^i ' 

wj„+i(^) := w(c/) whenever ^ ^ \Jj<n+i > 
if Gfc ^ Qn[jGn+i then ^%ri{9k,n) ■= il±ek,n)w{gk,n) and 
wj„+i(fi') := (l=F£^fc,n+i)w(5f) whenever 51 G Gfcfl^n+i and g ^ g^^n- 
Obviously, w{g) = |(w+„((7) + w~^{g)) . The estimates ()2.2|) imply that 
w^„ G W+ n V . Finally, if Gfc C ^„ IJ g„^^ and EgeG^ ^(S') = ^ then 

wj„(5() = {l±ek,n)^igk,n) + (l=F£^fe,n+l) (t-w(5(fc,„)) = tT£k,n+lit-l) . 

g&Gk 

This identity and the estimates £:fc,n,^fc,n+i < 1/2 imply that 
, , t+l l-t ^ + , , t + 1 

2 2[l-w[gk,n)) 2 

Let w^((7) := lim„_^oo w^„(5f). Then wq = |(w+ + w^) and, in view of ()2.2|) 
and (Q, w±(c/) G nV. 

Thus, under conditions of the theorem, a weight w G (5*^^ \ V^^) P| V 
can always be represented as a convex combination of two other weights from 
S^^ Pi V and therefore is not an extreme point. □ 

Remark 2.5. If the condition (g2) is not fulfilled then an extreme point of S^^ 
does not necessarily belong to . The simplest example is Gi = {gi,g2} , 
G2 = {g2,g3}, G3 = {g3,gi} and G = {Gi,G2,G3}. In this case 
consists of one weight which takes the value | at each vertex. 

Remark 2.6. The sets S^^ and may well be very poor or even empty. 
However, even in this situation Theorem 12.41 mav be useful. In particular, by 
the Krein-Milman theorem, under conditions of Theorem 12.41 we have 



S^'f^Wo = convP^^pjWo 
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Therefore S^' f| Wo = whenever VVo = 0. 

Remark 2.7. If the conditions (gi) and (g2) are fulfilled and V is a normal 
linear subspace of W then every extreme point w G ex {S^^ f]^) = fl ^ 
is Tm(V, V) -exposed. Indeed, if w'{g) > whenever w{g) = 1, w'{g) < 
whenever w{g) = and w' G V then we have (w,w') > (w,w') for all 

2.3. Topologies on the space of stochastic weights. The aim of this 
subsection is to describe locally convex topologies T on a linear subspace 
V D V^^ such that the T-closure of conv coincides with f] V . 
By Fatou's lemma we always have conv C 5® (as T is finer than To). 
Tychonoff's theorem and Fatou's lemma also imply that the set S'^ is To- 
compact. Therefore, in view of Theorem 12 .41 and the Krein-Milman theorem, 
under the conditions (gi) and (g2) we have S'^ = conv , where the clo- 
sure is taken in the topology of element-wise convergence To . However, if 
Gi contains an infinite set Gk then the set is not To-closed and, by 

Theorem 11.21 is not T-compact whenever the functional w —>■ ^pgGfe^(fi') 
is T-continuous. In this case (ii) does not directly follow from (i) and the 
Krein-Milman theorem. 

Definition 2.8. Denote by V-p and Vg the normal covers of the subspaces 
spanned by V'^ and S'^ respectively. If w G V5 , let W(fc) be the restriction 
of w to Gk and Pfe(w) := ||w(fc)||ii . 

Lemma 2.9. Let us enumerate the sets Gk in an arbitrary way and define 
Fn := Ufc=i ^fc ■ ^' '^^ %w(y^, V-p) -compact subset of V'-p then 

(2.4) sup ^ \^{g)W{g)\ ^0, n ^ 00 , 
whenever G satisfies (gi) and 

(2.5) sup ^ \^{g)W{g)\ ^0, n ^ 00 , 
whenever G satisfies (gi) and (g2)- 

Proof. If the conditions (gi) and (g2) are fulfilled then coincides with the 
To-closure of convP®. Therefore, in view of Fatou's lemma, it is sufficient 
to prove only the first statement. 

If (|2.4j) is not true then there exists 5 > and two sequences of weights 
{w„} C and {w^} C D' such that E_<,gG\F„ \^n{g)^'n{g)\ > 5 > for 
all = 1, 2, . . . Let ra^ be the minimal positive integer satisfying the estimate 
Yl,geF^^\F^ \^ri{g) ^'n{g)\ > '^/2 aud w* G Wq^V'^ be the weight which takes 
the same values as w„ on \ F„ and vanishes outside \Fn- In view 
of (gi), there exists a positive integer n* > n^, such that w*|g^ = for all 
k > n*. Let us take an arbitrary rii and define n^+i '■= n* , where j = 1, 2, . . . 
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Then for each g & G the sum w*{g) := w^ .{g) is equal either to or to 
1 and XlgeGfe ^^^id) — ^ ^ ~ 1,2,... Therefore the corresponding weight 
w* belongs to V'^ . On the other hand, rij oo and 

E l^'iaXM = E \^n,{gX^{g)\ > 6/2, 

g€F„.\F„ g&F„*\Fr.. 

which contradicts to Theorem 11.21 □ 

We do not assume in Lemma (2.91 that D' G Vs ■ Therefore, for each fixed 
n, the supremum in ()2.5|) may well be +oo . However, under conditions (gi) 
and (g2), it eventually becomes finite and converges to zero as n oo . 

Lemma 2.10. // the condition (gi) is fulfilled and D' is a '^wiy'si'^s)- 
hounded %„{y^,V-p)- compact subset of then the weights w' G D' are 
uniformly bounded. 

Proof. Let F„ be defined as in Lemma 12 .91 If the restrictions of weights 
w' G D' to Fn are not uniformly bounded then, for some k < n , their 
restrictions to Gk form an unbounded subset of l°° . This implies that the 
set D' is not Tw(V5, V5) -bounded. 

Assume that there exist sequences {gj}j=i,2,... ^ G and {w^}j=i 2,... G D' 
such that w'j{gj) —>■ 00 as j —>■ 00 and {gj} for any finite n. Since 

(gi) holds true, every vertex g belongs only to finitely many sets Gk and 
we can find a subsequence {gji}i=i^2,... with at most one entry at each set 
Gk ■ If ^(gji) = 1 and w(g) = whenever g ^ {gji} then w G and 
J2i\^i9ji)^'jii9ji)\ — Therefore, by Theorem II. 2| the set D' is not 

2^w(V^, Vp)-compact. □ 

Corollary 2.11. If the conditions (gi) and (g2) are fulfilled then the strong 
topology ly^iVsyVg) is generated by the norm 

(2.6) ||w||5 := suppfc(w) 

k 

Proof. Since the norm ()2.fi|l is lower To-semicontinuous, it is %hiVs,Vg)- 
continuous (see Remark |l.5|) . The set 

5® = {w G V5 : ||w||5 < 1} 

is absorbing and, in view of (12111) and Lemma ITTnl is Xm(V5, V5)-bounded. 
By Theorem 11.11 this set is Xb(V5, V^)-bounded, which implies that every 
'^hO^Sj V^)-continuous seminorm is continuous in the norm topology. □ 

Corollary 2.12. Let T be the locally convex topology on Vg generated by 
the seminorms pk , A; = 1,2, ... If the conditions (gi) and (g2) are fulfilled 
then the Mackey topology Tm(V5, V^) is finer than X and coincides with T 
on every %b{Vs,Vg) -bounded subset of Vs ■ 
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Proof. The seminorms pk are lower To-semicontinuous and satisfy 
Therefore, by Remark 11.51 %^{Vs,Vs) is finer than %. On the other hand, 
if f2 is a bounded subset of Vs then, in view of ()2.5p and Lemma f2.1Ul for 
every Mackey seminorm p on Vg , every x e and every e > there exist 
a positive integer m and 6 > such that 

{y eQ: Pki^ - y) < 5 , VA; = 1, 2, . . . , m} C {y e Q : p{^ - y) < e} . 

This imphes that every Tm(V5, V^)-neighbourhood of x in contains a 
T-neighbourhood. □ 

Remark 2.13. If the conditions (gi), (g2) are fulfilled and G does not coincide 
with the union of a finite collection of the sets Gk then the topology T 
generated by the seminorms pk is strictly coarser than Tni(V5, V^) . Indeed, 
in this case there exists a sequence of weights w„ G V-p such that Pfc(w„) = 
for all k < n and Pn(w„) — oo as n oo . This sequences converges 
to the zero weight in the topology T but is not Tb(V5, V^) -bounded and, 
consequently, is not Tin(V5, V^) -convergent. 

In the rest of this section we shall be assuming that 

(gs) one can enumerate the sets Gj in such a way that either G = or 
Gn+i (f- Fn for all sufficiently large n , where F„ := IJfc<n^fc ■ 
Every finite collection G = {Gx.G^-, ■ ■ ■ satisfies (ga). More generally, 

the condition (ga) is fulfilled whenever the number of finite sets is finite 
and the intersections of every two sets Gj,Gk G G is finite. In particular, 
(ga) is fulfilled for finite and infinite matrices (see Example 12. 3|) . 

Lemma 2.14. Let the conditions (gi) and (ga) be fulfilled, Gk be enumerated 
as in (gs), F„ := [j^^^Gk and Gi,„ be the collection of all sets Gk G Gi 
with k < n . Then Ihere exists a positive integer uq such that for every 
n > no and every weight w G "P® satisfying 

(2.7) ^w((7) = l, VGfeGGi.^, 

g&Gk 

one can find a weight w G whose restriction to Fn coincides with w|^^ . 

Proof. If for some positive integer ni there are no weights w G satisfying 
(EHI) with n — Ui then the lemma automatically holds true for ng — ni . 
Therefore we can assume without loss of generality that for each n = 1,2,... 
there exists a weight w„ G satisfying (j2.7j) . 

If G = F„ for all n > ui then, in view of (gi), Y.kY.g<^Gk^n{9) < 
2ni . This estimate and ()2.7|) imply that the set Gi,„ contains at most 2ni 
elements for each n = 1, 2, . . . . Therefore there exists a positive integer uq 
such that Gi_„ = Gi^„,) for all n > uq . In this case the inclusion w G 
and ()2.7p with n > imply that w G . 

If Gn+i ^ Fn for all n > ui then we take uq = ui . Given n > uq 
and a weight w G V'^ satisfying (j2.7p . we choose arbitrary vertices g^n+j G 
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Gn+j \ Fn+j-i and define w as follows: w((7) := w(5f) whenever g E Fn , 
w((y'ri+i) •= 1 for all j = 1, 2, . . . and w{g) := otherwise. Then w = w on 
Fn and w G V^^ because J^geCt ^(d) = 1 for all A; > n . □ 

Theorem 2.15. Let the conditions (gi)-(g3) be fulfilled and V be a normal 
subspace of W such that C V C V5 . Then 

(2.8) Pi V = convV^\ VGi C G , 

where the closure is taken in the Mackey topology Xm(V, V) . 

Proof. Since V C V5 , the functionals w — > J2geGk^^3^ '^wCl^, V')- 
continuous and, consequently, conv C f]^ ■ If w ^ conv V^' then, 
by the separation theorem (see, for example, |K], Section 20.7), there exist 
w' G V and e > such that (w,w') — (w,w') > e for all w G convP^^^ . 
Therefore, in order to prove (j2.8p . it is sufficient to show that for each fixed 
w G f]^ , w' G V and e > one can find w G conv V^^ such that 
(w, w') — (w, w') < e . 

Assume that the intersection Gkf]Gif] G^ contains more than one vertex 
so that GkClGiClGv^ = {5-1, 5-2, • • •} • Since J2j\^i9j)^'{gj)\ < 00 and 
IZj^idj) ^ 1 ) we have v/'^gi) > J^j^idj) ^'idj) some positive integer 
i. If w*{g) ■.= w{g) whenever g ^ GkOGiClGv, , w'^igi) ■=Y.j^i9j) and 
w*{g) := whenever g e GtClGiClG^ but g gi then w* G 5*^^01^ 
and (w*, w') > (w, w') . Therefore we can assume without loss of generality 
that Gw satisfies the condition (ci) of Proposition YI?^ 

Let us enumerate the sets Gk and define F^ and as in Lemma 12.141 
Let n > no and Gfc fl '^w = {s'l , 9^, •••} , where = 1, 2, . . . , n . By (gi), for 
every g^ there exists at most one positive integer / 7^ k such that g^ E Gi . 
Denote 

In view of (gi) and (ci), we have Ejf n(5'j) < • Therefore Vn{g^) — > as 
j — > 00 whenever the set Gk fl is infinite. If Gk fl G'w is finite, denote 
by ik the number of elements of Gk fl . If Gw is infinite, denote 

by jk the minimal positive integer such that 

(2.9) Vn{gi) + Y.^{g';) ^ ^ (7} ^ \ G, , Vj > 

(since Vnigj) 0, — ^ and Gw satisfies (ci), such a minimal 

integer exists). 

Let w„((7) := whenever g ^ Fn and w„(5f) := w((yf) for all g E Fn . 
Then (w — w„, w') — > as 00 because the series J2geG^(9)^'(9) 
absolutely convergent. Let m > maxjji, J25 ■ ■ ■ ,jn} , ^n,m{9) '■= whenever 
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Wn{g) = and 

{0 if j > "m, 

+ Ej>m if J = Jk < m, 

w{g) if j <m and j ^ jk ■ 

Then (w„ — w„^mj w') ^ as m — > oo for each fixed n because the series 
w((7j') w'((7^) are absolutely convergent and J2j>m^(9j) ^ ^■ 
The weight Wn,m vanishes outside a finite subset of G and, in view of 
()2.9|1 . belongs to S'^ and satisfies the condition ()2.7j) . Applying Theorem 
l2.4l to the family of sets {Gi f] Gw„,„, ■ ■ ■ ,Gnf] Gw„,™} and then the Krein- 
Milman theorem, we see that w„ ^ can be represented as a finite convex 
combination ^ • a, wi*L of some weights Wn^m G V'^ . Obviously, each 
weight Wn,L also satisfies ()2.7|) . By Lemma ?2.14\ we can find wi*m € V^^ 
such that wi*l„ = wi*L on the set F„ . If Wn,m '■= J2i<^i^n^rn then 
^n,m £ convP'^i and, in view of ()2.4|) . we have (w„_m — w„_m, w') < e/3 
for all m > max{ji, • • • ,jn} provided that n is sufficiently large. There- 
fore, choosing a sufficiently large n > hq and then a sufficiently large m > 
maxjji, j2, ■ ■ ■ ,jn} , we can make the right hand side of the identity 

(w, w') - (w„,^, w') = (w-w„,w') + (w„-w„,^,w') + (w„,„-w„,„,w') 
smaller than e . □ 

Remark 2.16. Theorem 12.151 implies that ^ whenever S^^ ^ and 
G satisfies (gi)-(g3). If Gn+i <f- \Sk=\ ^ n = 1,2, . . . then, using the 

same procedure as in the proof of Lemma I2.14[ one can show that P*^ 7^ . 

Remark 2.17. If V is a proper normal subspace of Vi then V[ is a proper 
subspace of V and the Mackey topology Tm(V, V) is strictly finer than 
2^m(Vi,V(). Therefore choosing a smaller space V in Theorem l2.15l we obtain 
a stronger result which is valid for a narrower class of Gi-stochastic weights. 

Remark 2.18. Taking V = Vs in Theorem 12. 151 and applying Corollarv I2.12[ 
we obtain = conv , where the closure is taken in the topology gen- 
erated by the seminorms pk ■ This topology is metrizable. Therefore, under 
conditions (gi)-(g3), for every w G S^^ there exists a sequence of weights 
w„ G convV^^ such that Pa:(w — w„) — as n — > oo for all k = 1,2, . . . 

The following simple example shows that, generally speaking, conv does 
not contain f]V if we take the closure in the strong topology Tb(V, V). 

Example 2.19. Let G be an infinite collection of mutually disjoint sets 
Gk such that Gk contains k elements. Then the weight w which takes 
the values k~^ on Gk belongs to 5*^ . On the other hand, for every weight 
w G conv V'^ there exists a positive integer n such that the number of nonzero 
entries in w|(^^ does not exceed n for every k . Therefore ||w — w||5 = 1 
for all w G convP® , where || ■ is defined by (j2.6p . 
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The strong closure of the convex hull of the set of permutation matrices is 
also strictly smaller then the set of doubly stochastic matrices jTsj. 



3.1. Notation and definitions. In the rest of the paper (with the exception 
of the proof of Theorem 13. ISj) we shall be assuming that W is the space of real 
matrices w = {wij}ij=i^2,... and the sets Gk are the rows and columns (see 
Example 12. 3|) . Recall that in this case G satisfies the conditions (gi)-(g3), 
and 5^ are the sets of doubly stochastic and sub-stochastic matrices 
respectively, is the set of permutation matrices and V'^ is the set of 

sub-stochastic matrices whose entries are equal either to or to 1. For the 
sake of definiteness we shall consider only infinite matrices; the corresponding 
results for finite matrices are much simpler and can be proved in a similar 
manner. 

Every matrix w G W generates the linear operator 



with domain V{w) = {x G M°° : ^ | Wij Xj \ < oo , Wi = 1,2, . . .} . We 
shall denote this operator by the same letter w . Obviously, l°° C D(w) for 
all w G 5® and V{w) = ]R~ for all w G P^ but I'(w) ^ whenever w 
has a row with infinitely many nonzero entries. 

Lemma 3.1. If X C l°° is a symmetric perfect space and X ^ then the 
operator generated by a matrix w G 5® maps X into X and is continuous 
m the topologies %^{X,X') , %^{X,X') and Tb(X,X') . 

Proof. Since X ^ , by Remark 11.111 we have X' C . The inclusions 
X C , X' C and Q imply that x' ® x G for all x G X 
and x' G X' , which means that w maps the perfect space X into itself. 
Similarly, the transposed operator w"^ maps the perfect space X' into itself. 
Therefore |(wx, x')| = |(x, w'^x')| is a 1'w(X, X')-continuous seminorm on 
X for each x' G X' and is a Tw(X', X)-continuous seminorm on X' for 
each X G X. This implies that w is Tw(X, X')-continuous and is 
Xw(X', X)-continuous. Since the continuous operator maps compact 
sets into compact sets and bounded sets into bounded sets, the operator w 
is Xm(X, X')-continuous and Tb(X, X')-continuous. □ 

Remark 3.2. Let X C be a symmetric space, X ^ and {x' ® x} 
be the set which contains one element x' (g) x , where x G X and x' G X' . 
Applying (Q to D' = {x' Ox}, we see that the set is Xw(X,X')- 
bounded. Therefore Theorem II . II implies the first statement of Corollarv ll.7l 
If fl' is a Tw(X', X)-compact subset of X' then, by Theorem 11.21 the set 
D' := Ux'ec'i^' ® ^} T„(Vp, V-p)-compact. Therefore Theorem 11.21 and 
(j2.4|) imply the second statement of Corollary 11.71 



3. Operators generated by stochastic matrices 



oo 



oo 



(3.1) 
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Definition 3.3. Let G,. be the set of all rows, S'^ := 5*^'' and US^ be the 
set of matrices w = {wjj}j,j=i,2,... G <S^ such that Wij = \{ui,ej)H\'^ , where 
{ci, 62, . . .} is a complete orthonormal subset of a separable complex Hilbert 
space H , {ui,U2, ■ ■ ■} is an orthonormal subset of the same Hilbert space 
H and (■, ■)h is the inner product in H . 

If the set {ui,U2, ■ ■ ■} is also complete then the inner products {ui,ej)H 
coincide with entries of a unitary matrix. In this case the corresponding 
matrix w eUS^ is doubly stochastic and is said to be unistochastic. In the 
finite dimensional case every matrix w G US^ is unistochastic. 

Definition 3.4. If x = {xi, xa, . . .} G , let 

m m 

(3.2) i?+(x) := sup ^Xj„ and i?-(x) := inf ^^Xj^, 

where m = 1,2,... and the supremum and infimum are taken over all subsets 
of X containing m elements. Denote by Qx the set of all sequences y = 
{yi,y2,---} eM°° such that 

m 

(3.3) i?;,(x) < < i?+(x) 

n=l 

for each m = 1,2, ... ,p and each collection of m distinct positive integers 
ii, . . . ,im- Finally, let Xq^ be the subspace of M.°° spanned by Qx • 

By Remark 11.111 Xq^ is the minimal symmetric perfect space containing 
X whenever x and Xq^ = whenever x G /"^ \ {0} . 

Definition 3.5. If x = {xi, Xs, . . .} G M~ , let 

Vx be the linear space of matrices w such that x G T>{w) ; 
P^^ , 5*^^ and US^ be the sets of all sequences y G such that 
y = wx for some w G , w G f] Vx and w G US'' f] Vx 
respectively and := S^'' . 

Obviously, the sets S^^ , P^^ Qx do not depend on the order of entries 
in the sequence x . We have C S'^C S^, P^^ = P^, C US'^ C and 
P^ = for all X G (see Definition IH)!) . 

Lemma 3.6. Let x := {xi,X2,...} G M°° , {ei,e2,...} be a complete or- 
thonormal subset of a separable complex Hilbert space H and A be the self- 
adjoint operator in H such that Acj = Xj Cj . Then y G f/S^ if and only if 
there exists an orthonormal set {ui} C Pd^l^/^) such that yi := {Aui.Uijn ■ 

Proof. A sequence y belongs to US^ if and only if = J2j \ {ui,ej)H\'^Xj , 
where {ui} is an orthonormal set such that J2j \ {'^ij^j)H\^\xj\ < oo for each 
i = 1, 2, . . . These estimates are equivalent to the inclusion {ui} C I'dAI^/^) . 
Since Ui = J2j{ui, ej)H ej , we have y^ = Y,j \ ej)H\^Xj = {Aui, ui) . □ 
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3.2. The sets US^. , and Qx • The main resuh of this subsection is 
Theorem 13. 101 which clarifies the relation between these sets. Given a sequence 
X and a set A C M , we shall denote by x A the sequence obtained from 
X by removing all its entries lying outside A . 

Lemma 3.7. Assume that the sequence x G has one accumulation point 
A e M, y G Qx and y f](— oo, A) = . Then y E US^ provided that 

(a) either xf][A, +oo) is infinite and tl{i : = A} < : xj = A} 

(b) or xf][A, +oo) is finite and ~ ^)+ ~ J^iiVi — A)+ = e > . 

Proof. Let A be defined as in Lemma 13.61 In order to prove the inclusion 
y G f/^x , we have to find an orthonormal set {ui, U2, ■ ■ ■} C I?(|y4|^/^) such 
that Hi := {Aui, Ui)H ■ 

Assume first that (a) holds true. Then there are two entries Xj^^Xk^ G 
xf][A, +CX3) such that yi G [xj^jX^J and xf](xjj,XfcJ = 0. If yi = axi^ + 
(1 — and Ui := a^/'^Cj^ + (1 — ay/'^Ck^ then UmiHh = 1 and yi = 

{Aui,Ui)h ■ Let x^^) be the sequence obtained from x by replacing the two 
entries and Xk^ with one entry + x^^ — yi and y*^^) be the sequence 
obtained from y by removing the entry yi . The entries of x*^^) coincide with 
the eigenvalues of the self-adjoint operator Ai := IIiAlj:^^ in the Hilbert space 
Hi := UiH , where Hi is the orthogonal projection onto the annihilator of 

Ml . 

If yi = X then at least one of the entries Xj^ , x^j coincides with A , which 
implies that x*^^^ and y'-^-* are obtained from x and y by removing one 
entry A. Therefore the sequences x*^^) and y^^-* satisfy the condition (a). 
We also have y*^^-* G Q^^w ■ Indeed, if the number of entries in x lying 
in the interval (xfcj,+oo) is equal to p then i?+(x(^)) = Rmi^) whenever 
m <p . If m>p then i?+(x(^)) = i?^^;^(x) — yi> J2'k=iyik each subset 

{vh,- ■ ■ ,yim} ^y^^^ ■ 

Applying the same procedure to x'^*~^\ y'^*^^'' and with i = 2,3, . . . , 
we can find Xj-,Xki G x^*"-*^) , Ui E H and x*^*) such that yi G [xj-,Xfc.], 
:>c^'-^^ f]{xj^,Xk,) = 0, Ili_iUi = 0, \\ui\\H = 1, Vi = {Ai_iUi,Ui)H and 
-^m(y^*^) — -^m(^''*'') • The entries of x*^*) coincide with the eigenvalues of 
Ai := IljAj-iljj j^ , where Ilj is the orthogonal projection onto the annihilator 
Hi of the set {ui, . . . , Ui} . The set {ui, U2, ■ ■ ■} , obtained by induction in i , 
is orthonormal and every its element Ui is a finite linear combination of the 
eigenvectors 61,62,... The latter implies that Ui G ^{A) C Pd^l^/^) and 
yi = {Ai_iUi, Ui)H = {Aui, Ui)H for all z = 1, 2, 3, . . . 

If (b) holds true then A is an accumulation point of xf](— 00, A) . Without 
loss of generality we may assume that the sequence xf](— oo,A) converges 
to A and that Tliji."^ < (this can always be achieved by removing 

a collection of entries from x). Let us denote x^^-* := x, y*^'^-' := y and apply 
the same procedure as above with Xj- , x^- defined as follows: 

Xfc. is the smallest entry of x*^*"^) lying in the interval [yi, +00) , 
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Xj. is either the largest entry of x*^* lying in (A, yi) or, if such an 
entry does not exists, Xj. is an arbitrary entry of xf](— oo. A) . 

The inequality ^^.(A - Xj)+ < e/2 implies that R^iy^'^) < i?+(x(*)) - 6/2 
for all m = 1, 2, . . . . Therefore, by induction in i , we can find the required 
representation for all entries . □ 

Lemma 3.8. Assume that the sequence x G has two accumulation points 
A,/i e R and \ < fi . If y = y f][X, fi] , '^\{i : yi = X} < tl{j : Xj < A} and 
tl{2 : yi = /i} < tl{j : Xj > fx} then y eUS^. 

Proof. Under the conditions of the lemma, there exists a set of distinct posi- 
tive integers {ji,j2, ■ ■ ■ , ki, k2, . . .} such that yi G [xj., x^J for all i = 1, 2, . . . 
If yi = aiXj. + (1 — ai)xki and A is defined as in Lemma 13.61 then yi = 

{Aui, Ui)H , where Ui := aJ'^Cj^ + (1 - ad^^'^Gk, ■ □ 

Definition 3.9. If x = {xi,X2,...} G ]R°^ , let x~ := lim inf j-^oo a;^ G M, 
x"*" := lim supj_^o^ Xj G M and x be the sequence obtained from x by adding 
infinitely many entries x^ whenever > — oo and infinitely many entries 
x"*" whenever x~^ < +oo . 

Theorem 3.10. For every x = {xi,X2, . . .} G M°° we have 
(3.4) USl = S: C Q^ = Q^ = us; 



X • 

m 



Proof. The equality Qx = Qx immediately follows from the definition of Q 
If y G then for every collection of m distinct positive integers ii, . . . ,i 
we have Vik — J2j ^j^j ; where aj G [0, 1] and aj = m . This 

implies (j3.3|) . Therefore C Q^. 

It remains to prove that y G US^ provided that either y G 5^ or x = x 
and y G Qx • We are going to show that there exist countable families of 
disjoint subsequences x„ C x and y„ C y such that |J,^ x„ = x , |J,^ Yn = y 
and y„ G US^^ . Obviously, this implies that y E US^ . Given a sequence 
z, in the rest of the proof we shall denote z+ := zP|(x^,+oo), z~ : = 
z f](— oo, x~) , z+ := z n[^^5 +oo) and z_ := z f](— oo, x^] . 

Assume first that x = x . Then we can split x into the union of three 
disjoint subsequences xi,X2,X3 such that xi = x+ , X2 = x~ , X3 does not 
have any entries lying outside [x~,x"'"] and X3 has infinitely many entries x^ 
whenever x^ is finite. If yi := y_|. , y2 := y_ and yo := y f]{x~ , x~^) then, 
by Lemmas 13.71 and 13. 8( we have y„ G (5x„ whenever y G Qx • Therefore 

Qx c us; . 

Assume that y E S^. We have to consider the following possibilities: 

(1+) y'^ 7^ , x+ is infinite and 

(3.5) hminf (i?+(x+)-i?+(y+)) = 0; 

m— >oo 

(2+) y^ 7^ , x+ is finite and (j3.5|) holds true; 
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(3+) 7^ , x+ is infinite and 

(3.6) i?+ (x+) - i?+ (y+) >e>0, Vm = 1, 2, . . . ; 

(4+) x+ 7^ is finite and ()3.fi|l holds true; 
(5+) = and x+ is infinite; 
(6^) y+ = and x+ = . 

Note that (6',_) and the inclusion y E imply 

(6+) y+ = , x+ = and ^{i : Vi = x+} < ^{j : Xj = x+} . 

We shall say that x and y satisfy (n_) if the corresponding condition (n_|_) 
is fulfilled for — x and — y . 

Assume first that (1+) holds true. By Lemma EUl we have y+ G SU^+ . 
Let y := y \ y^ and x := x \ x"*" be the sequences obtained from y and x 
by removing all the entries yi G y^ and xj G x"*" respectively. If y = wx 
and w G tS*" then, in view of ()3.5j) . the entry Wij of the matrix w is equal 
to zero whenever xj > x~^ and Ui < x^ . Therefore y = wx , where w G iS*^ 
is the matrix obtained from w by crossing out all the zth rows correspond- 
ing to Hi E . If limsupjXj = a;"*" < x"*" and x, y satisfy (1+) then, 
in a similar manner, we remove the subsequences x"*" := xP|(x^,+oo) and 
y"*" := y f](x"'", +CX)) . After sufficiently (possibly, infinitely) many iterations 
we either obtain two required families of disjoint subsequences x„ and y^ or 
end up with two remaining sequences satisfying one of the conditions (2_|_)- 
(6+). If (1_) holds true then we can apply the same procedure to the se- 
quences —X and — y . Therefore it is sufficient to consider the sequences x 
and y such that y G 5"^ and one of the conditions (2±)-(6±) is fulfilled. 

Assume that (2_|_) is fulfilled and y = wx, where w G iS'' . If x has 
finitely many entries x"*" , we define x^ := x+ . The condition ()3.5|1 imply 
that the entry Wij of the matrix w is equal to zero whenever Xj < x~^ and 
Vi^ ■ Therefore the number of entries in y_|_ does not exceed the number 
of entries in x^, and y+ = w^^x^, for some finite matrix w^ E . In the 
same way as in the proof of Lemma 13.71 one can show that y+ G S^^ . If 
X has infinitely many entries x~^ then we represent x as the union of two 
disjoint subsequences x and x^ such that x^ = x''" , x (^(x"*", +oo) = and 
X contains infinitely many entries x~^ . By Lemma 13.71 we have y+ G f/ S'^^ . 

In both cases the sequences x \ x^ and y \ y+ satisfy (6+). If (2„) holds 
true then, in a similar way, we can remove all the entries lying below x^ . 
Therefore it is sufficient to prove the inclusion y G US^ assuming that x 
and y satisfy ()3.3|) and one of the conditions (3±)-(6±). 

If (3+) is fulfilled then we choose a subsequence x* of the sequence x"*" 
in such a way that the remaining sequence x"*" \ x* contains infinitely many 
entries and i?^(y+) < -R^j(x*) for all m = 1,2,... By Lemma 1X71 y+ G 
USl_^ If we remove all entries Xj G x* and yi G y"*" then the remaining 
sequences x \ x* and y \ y"*" satisfy (5+). Similarly, if (3_) holds true then, 
after applying this procedure to — x and — y , we arrive at (5_). Therefore 
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we can assume without loss of generality that x and y satisfy (jH.Hj) and one 
of the conditions (4±)-(6±). 

Let (4+) be fulfilled. If y+ = then we simply remove all the entries 
x'j' > and arrive at (6+). Otherwise we choose a subsequence of the 
sequence x in such a way that x_|_ C x^ and x+ is an accumulation point 
of both sequences x^, and x \ x^ . Lemma 13.71 implies that y+ G US^^ . 
Removing the subsequences y+ , x^ and all remaining entries Xj > x~^ , we 
arrive at (6+). If (4_) is fulfilled then, in a similar manner, we can remove 
the entries xj G (— oo,a;^) and the entries yi G (— oo,x^] so that (6_) holds 
true. 

Finally, under conditions (5±) or (6±) the inclusion y G US^ follows from 
Lemma 13.81 □ 

Theorem 13. lUI implies, in particular, that the set US^ is convex. Note that 
the set of matrices US^ is not convex even in the finite dimensional case (see 
Example 14. 3|) . Since the set Qx is Tn-closed. Theorem 13. 101 also implies that 



(3.7) convP^ C 5^ C Vx G , 

where the closure is taken in any topology which is finer than To . 

Corollary 3.11. Let X be an arbitrary topology on Xq^ , which is finer than 
To and coarser than the Mackey topology '^■^{Xq^, X'q^) . Then 

(3.8) coHvP^" = = Q^, VxGM°°, 

where conv and are the sequential %-closures of the sets conv and 
respectively. 

Proof. In view of (|3.7|) . it is sufficient to prove (j3.8p for 1 = %ja{XQ^, X'q^) . 
In the rest of the prove fl denotes the sequential Tni(XQ^, XQ^)-closure of 
the set Q G Xq^ and conv Q is the sequential ^^(Xq^, XQ^)-closure of its 
convex hull. 

Let V^^x := V^f^Vx, where Vs is the subspace introduced in Definition 
12.81 By Lemma 13.11 we have wx G Xq^ for all w G V^^x smd, conse- 
quently, x' ® X G V^ ,, for all x' G X'q^ . If x ^ then Xq^ = R°° and 
%^{Xq^,X'q^) = To is a metrizable topology. If x G then V^^x = ■ 
Therefore Theorem 12. 151 and Remark 12. 181 implv that 5*^ C conv P^ = . 

Note that 

(*) for each e > there exists x^ G P^ such that x — x^ G and 
||x - Xell^i < e . 

Indeed, if x^ < +oo then we can always find a subsequence {xj^}k=i,2,... of x 
such that the /^-norm of the sequence {x^ ~ Xj^}k=i^2,... is smaller than e/6. 
Similarly, if x~ > — oo then there exists a subsequence {xi^}n=i,2,... such 
that in 7^ jk for all k,n and the /^-norm of the sequence {x~ —Xi^^}n=i,2,... is 
smaller than e/6. The required sequence x^ is obtained from x by replacing 
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the entries and x" with Xjjj. ^ and Xi^^^-^ and changing the entries Xj^, 
and Xj,^ of the sequence x to Xj^^, and Xi^^ respectively. 

In view of Remark 11.121 (*) imphes that conv C conv . Since Qx 
is sequentially closed, applying Theorem 13.101 and taking into account the 
identity conv P^ = 5"^ , we obtain Qx = = conv C conv P^ = 

Qx. □ 

Remark 3.12. If x' G X' contains a subsequence which converges to zero and 
X G Px then one can find x„ G Px such that (x — x„, x') ^ as n ^ oo . 
This observation and the separation theorem immediately imply that, under 
the conditions of Corollarv 13.111 

(1) conv Px = Qx whenever x ^ , 

(2) convPx = Qx •= {y ^ <5x : 1/1 + 1/2 + • • • = a;i + X2 + . . .} whenever 
X G and T is the /^-topology (indeed, if x' G separates Px and 
X* G Q* and c' is an accumulation point of the sequence x' then, by 
the above, x' := {x[ — d .x'^ — c', . • •} separates P^ and x* , which 
contradicts to Corollarv 13. lip . 

The latter result is well known (see, for example, |Malj . Theorem 4.2), the 
former was proved in |Malj for the topology T generated by a symmetric 
norm which satisfies (|1.3|) . 

Remark 3.13. By Corollarv 13.111 ()3.8p holds true in the Mackey topology 
'^m(^°°,^^) whenever x G . If, in addition, a;-,- — > c 7^ as j — > cxd then, 
applying Corollarv 13.111 to the sequence x := {x\ — c, 0:2 — c, . . .} , one can 
show that ()3.8|) remains valid with respect to a stronger topology. 

3.3. Extreme points. Theorem 12.41 suggests that exS*^^ C P^^ ■ In the 
next theorem we prove this inclusion only under some additional conditions. 

Definition 3.14. Denote Sj^^^^ := {y^™) G R" : y G S^^} , P^^^^ : = 
{yM G : y G Px«^} , S^^^^ := 5,%) and P^;^^) := P^l^^ , where yM 
is defined as in (11. Ij) . 

Clearly, S^l^^ = S^^ and P^%) = P^^ . 

Theorem 3.15. Let x = {xi,X2, . . .} G M°° and Gi be a set of rows and 
columns. Assume that at least one of the following conditions is fulfilled: 

(1) m < 00 , 

(2) m = 00 and either Gi C G,. or Gi contains all columns, 

(3) m = 00 and Xj 7^ Xk whenever j ^ k . 

Then exS^^^^^ C P^^^^) ■ holds true and x does not contain zero entries 

then wx ^ exS^^ whenever w G [S^^ \ P^^) H'^'x • 

Proof. Let w G 5*^^ fl'^'x and (wx)*^™-' G exS"^^^^^. The proof consists of 
two parts. In the first part we shall construct a special matrix w G Vx 
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such that (wx)("^) = (wx)^'") . Then we shall show that (wx)('") = (wox)^"*) 
with some wq G V^^ and that w — w E V^^ whenever (3) holds true and 
X does not have zero entries. 

Let A be the countable set of all distinct values taken by the entries of x , 
Ja = {ji, i2, ■ ■ ■} be the ordered set of all indices ji < j2 < ... such that 
Xj^ = A and Vi^x ■= Ej.ej;, ^ih ■ 

If (3) is fulfilled then we take w := w. Otherwise, given m < +oo and 
an ordered set Ja = {ji,j2, • • •} , we define 

(1) Wi^''^'' := Vi^x and w^ijl^^^ := for all k > 1; 

(2) if 1 < i < m and ji G Ja is the maximal positive integer such that 

> , then 



~ (m;X) 
~ {m;X) 
~ (m;A) 



= for all A; < Z and k> l + l, 
= min{ Vi,x , 1 - En=\ } and 

(m;A) 



Let w^"*^ be the m x oo-matrix whose entries wIT^ coincide with w,-™'^^ for 
all j — jk G Ja . Obviously, we have w^"*) G Vx and w^"*^x = (wx)^"*) . For 
each A G A the matrix w^"*^ has at most two nonzero entries lying at the 
intersections of a given ith row and the JA-columns. The minimal column- 
number of such a nonzero entry in the (i + l)th row is not smaller than the 
maximal column-number of a nonzero entry in the ith row; in other words, 
the set of nonzero entries lying in the JA-columns is ladder-shaped. 

If (2) is fulfilled then we take w := w^'"-' . The matrix w*^™) has the same 
row-sums as w and its column-sums Uj := Yll^i'^ij^^ '^ot greater than 
1. If all column-sums of w are equal to 1 then each column-sum of w^"*) is 
also equal to 1. Therefore w G S^^ . 

If (1) is fulfilled, let us consider the ordered set J = {ji,j2,---} of all 
indices ji < j2 < . . . such that uj^, < 1 . Note that every set Ja contains 
at most one element of J . Let w = {wij} be the oo x oo-extension of the 
m X oo-matrix w*^™^ defined as follows: 

(1) Wij = for all j ^ J and i > m; 

(2) := 1-Uj, and := mm{l-Uj^ , 1 - En=l 
for all jk G J with A; = 2, 3, . . .; 

(3) if i > m + 1 and ji G J is the maximal positive integer such that 

> then 
Wiji_ := for all jk G J with k < I, 
Wij^ := 1 - Uj^ - 'W(i-i)j^ and 

Wij^^ := min{l - uj,^ , 1 - Yln=i *yn} for all jk G J with k> I . 
We have ^^-^j Uj < m and, consequently, Xljej (1 ~ '"i) — • Therefore, 
for each i > m , the set of nonzero entries in the ith row of the matrix w 
is finite and non-empty. Since w^™^ G Vx , this implies that w G Vx . All 
column-sums of the matrix w are equal to 1. Its ith row-sum coincides with 
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the ith row sum of w whenever i < m and is equal to 1 whenever i > m . 
Therefore w G S^^ . The set of nonzero entries Wij with i > m is also 
ladder-shaped. More precisely, the jth column contains at most two such 
nonzero entries (if it does then these entries lie in adjacent rows) and the 
minimal column-number of a nonzero entry in the {i + l)th row is not smaller 
than the maximal column-number of a nonzero entry in the ith row. 

Let G the subgraph of G, which contains all the vertices Qij (that is, the 
intersections of ith rows and jth columns) such that w{gij) := Wij G (0, 1) . 
Denote G\ := {gij E G : j E 3\} and G' := {gij E G : i > m} . 

Assume first that G contains an admissible cycle (^j^j^ —>■ gi^j^ —>■ gi^j^ —>■ 
■■■ ^ gi,j, . Replacing gi^j^ gi^^^j^ 9h+^j,+^ ■ ■ ■ ^ 9i,+d,+i with 
9ikjk ~^ 9ik+ijk+i whenever ik = ik+i , we obtain an admissible cycle gi'j/^ 
9i'2j'i ~^ 9i'23'2 ~^ ■ ■ ■ ^ 9i'^j[ which has at most two vertices in every row. By 
our construction, the subgraphs G\ and G' are ladder-shaped and, for every 
A G A, the intersection G\^G' contains at most one element. Therefore 
this admissible cycle has at least two vertices lying in the same ith row with 
i < m but in distinct sets Gx . If are defined as in the part (2) of 
the proof of Theorem 12.41 then G S^^ fl'^'x , w = | (w+ + w^) and 
(w+x)('") ^ (w-x)('") . Therefore (wx)('") ^ exS'J^^) . 

Thus, the graph G does not have any admissible cycles. Let us take an 
arbitrary vertex gij^^ = go E G with i < m , define as in the part 

(3) of the proof of Theorem 12.41 and denote w* := | (w^ — w^) . Then 
wf G 5*^1 n Vx , w = I (w+ + w") and 

^ijo = ±^ ^ijo ' '^ij = Wij^ (1 - Wijo)~^ Wij , Vj ^ jo . 

Since (wx)^™^ G exS^^^^^^ , we have w*x = which implies that WijgXjg = 

Wijo (1 - Wijoy^ ^j^jo ^io = Y.'jLi ^ij^j ■ The integer jo can be 

chosen in an arbitrary way. Therefore for each i < m we have either Wij = 
or j G Ja^ , where := YlJLi "^ij^j ^ ^ • The first row of w may contain 
only one nonzero entry Wij with j G Jai . If it does then Xj = WijXj and, 
consequently, either wij = 1 or = Ai = . By induction in i , the same is 
true for all z = 1, 2, . . . , m ; namely, each of the first m rows either contains 
one entry 1 in a JA^-column corresponding to some Aj 7^ or has nonzero 
entries only in the Jo-columns. If Jq = , this implies that w G . If 
Jo 7^ then, by Remark 12.161 there exists a matrix wo G whose entries 
at the intersections of the first m rows and the JA^-columns with Aj 7^ 
coincide with the corresponding entries of w. Since (wx)*^™") = (wx)^"^^ = 
(wox)'^''"\ this completes the proof. □ 

4. Applications to spectral theory 

4.1. Notation and definitions. Let if be a separable complex Hilbert space 
with the inner product {■,-)h and norm || • \\h . For the sake of definiteness, 
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we shall be assuming that dim if = oo; the finite dimensional versions of our 
results are either well known or can be proved in a similar manner. 

Consider a linear operator A in H and denote by Qa['] its quadratic form 
defined on the domain V^Qa) '■= P(|v4|^/^) . We shall always be assuming 
that the operator A is self-adjoint. Let cr{A) , ac{A) , and aess{A) be its 
spectrum, continuous spectrum and essential spectrum respectively and let 
(Tp(A) = {Ai, A2, . . .} be the set of its eigenvalues. As usual, we enumerate 
the eigenvalues Xj taking into account their multiplicities. If A G M and 
Mf] A is a Borel set, we shall denote by IIa and A^ the spectral projection 
of A corresponding to M A and the restriction of A to the subspace HaH 
respectively. 

Definition 4.1. Let (j^g(yl) and (Jess(^) be the subsets of M such that 
A G o-^g(y4) if and only if dimU^x^^^H = 00 for all /i > A , 
A G (T^g(A) if and only if dimn(^ a]-^^ = 00 for all /i < A , 

and aess(A) := a~^{A)[ja+JA) 

Obviously, aess{A) = Rf]aess{A) , +00 ^ cri(A) and -00 ^ o-~^{A) . We 
have ±00 G o"ess(^) if and only if ±A is not bounded from above. 

Definition 4.2. If m is a positive integer or m = cxo , let 

(1) (j(m. A) be the set of vectors x = (xi, X2, . . .) G such that Xj G 
(J {A) for each j and the number of entries Xj = X ^ cress(^) does not 
exceed the multiplicity of the eigenvalue A ; 

(2) (Tp(m, A) be the set of vectors x = (xi,X2,...) G such that 
Xj G (Tp{A) for each j and the number of entries xj = X does not 
exceed the multiplicity of the eigenvalue A . 

If u = {ui,U2, . . .} is an orthonormal subset of V{Qa) which contains m 
elements Uk , denote Qyi[u] := <5yi[M2]5 • • •} G IR™ and define 

(3) S(m, A) := { y G M™ : y = Qa[u] for some u C V{Qa) } • 

The sets a{m,A), ap{m,A) and S(m, A) will be called the m-spectrum, 
point m-spectrum, and m-numerical range of A respectively. 

The m-spectra and m-numerical range are symmetric with respect to per- 
mutations of the coordinates x^- The cx)-spectra and 00-numerical range are 
subsets of M°°, whose projections onto the subspace spanned by any m co- 
ordinate vectors coincide with the m-spectra and m-numerical range. In 
particular, a{l,A) = cr{A) , crp(l,y4) = crp{A) and T,{1,A) is the numerical 
range of the operator A . Since cr{A) is a closed set, the m-spectrum a{m, A) 
is closed in the topology of element-wise convergence and, consequently, in 
any finer topology. 

Definition 14.21 can be extended to an arbitrary linear operator A acting 
in the separable Hilbert space H . In |BDj . Section 36, the authors defined 
a matrix m-numerical range as the set of all m x m-matrices of the form 
IIAn, where 11 is an orthogonal projection of rank m < 00. Halmos defined 
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an m-numerical range as the set of traces of such matrices (see jH], Chapter 
17). Our definition hes in between: we consider the sets of diagonal ele- 
ments of the matrices UAH instead of their traces. Yet another concept of 
multidimensional numerical range, related to a given block representation of 
the operator A , was introduced in |LMMTj . Halmos' m-numerical range is 



always convex (in the self-adjoint case this immediately follows from Corol- 
lary The m-numerical range E(m, A) is convex if A is self-adjoint. The 
matrix m-numerical range considered in |BDj and the multidimensional nu- 
merical range introduced in LMMTj are not necessarily convex. The latter 
depends on the choice of block representation and is not unitary invariant. 

If A A* then S(m, A) does not have to be convex, even if the operator 
A is normal and dim H < oo . The following simple example was suggested 
by A. Markus pa2l . 

Example 4.3. Let A = {aij} be the diagonal 3 x 3-matrix with an = i, 
= 1 and = 0. Then {2,1,0} G S(3,A) and {0,i, 1} G S(3,A). 
However, the half-sum {f , | + f , |} does not belong to S(3, A) . In the same 
way as in Lemma f3.(i[ one can show that S(3, A) = [J^ w z , where z is the 
three dimensional complex vector {0,2,1} and the union is taken over all 
unistochastic 3 x 3-matrices w . This implies that the set of unistochastic 
matrices is not convex. 

In |FWj the authors proved that conv (Tp(m, A) = conv S(m, A) whenever 
A is a normal m x m-matrix. There are also some results on the so-called c- 
numerical range of a finite matrix A, which is defined as the image of E(m, A) 
under the map x — >■ (x, c) G C where c is a fixed m-dimensional complex 
vector (see [UEI, [MMF] . jMS]). 

4.2. Extreme points of the multidimensional numerical range. We 

shall need the following simple lemma. 

Lemma 4.4. // a{A) C [A_,A+] and X± G cress{A) then S(oo,A) coincides 
with the set of all sequences z = {zi, Z2, ■ ■ ■} such that Zi G [A_, A+] for all 
i and the number of entries Zi = X± does not exceed the multiplicity of the 
eigenvalue X± (we assume that the multiplicity is zero whenever X± is not 
an eigenvalue). 

Proof. The spectral theorem implies that every sequence z G Ti{oo,A) satis- 
fies the above two conditions. On the other hand, if zi G [A_, A+] then, using 
the spectral theorem, one can easily find ui G T>{A) such that \\u\\h = 1 and 
Zi = Qa[ui] . Clearly, ui is an eigenvector whenever zi = A_ or zi = X^ . If 
Hi is the orthogonal projection onto the annihilator of Ui and Ai := IIiAIIi 
then T>{Ai) = T>{A) and A — Ax is a finite rank operator. Since a finite rank 
perturbation does not change the essential spectrum, by induction in i we 
can construct an orthonormal set u = {ui\ C T>{^A) such that Zi = QA[ui] 
for all i = 1, 2, . . . □ 
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Definition 4.5. We shall say that x = {xi, X2, . . .} G (t(oo, A) is a generat- 
ing sequence of the self-adjoint operator A if 

(1) either adA) = 0, x C ap{oo,A) and x contains all the eigenvalues 
Xj of A according to their multiplicities; 

(2) or ac{A) ^ and x can be represented as the union of three disjoint 
subsequences, one of which is defined as above and the other two lie 
in the open interval (inf (Tc(A), sup crc(v4)) and converge to info"c(v4) 
and supcrc(A) respectively. 

Theorem 4.6. // x is a generating sequence of A then S(m, A) = 5*^ • 

Proof. Since S(m, A) and 5^ coincide with the projections of T,{oo,A) 
and onto the subspace spanned by the first m coordinate vectors, it is 
sufficient to prove that J2{oo,A) = S'^ . If x is another generating sequence 
then, by Lemma I3.8( x G . Therefore does not depend on the choice 
of generating sequence x . 

Let A~ := inf (Tc(A) , A"*" := supcrc(A) , A := (inf (Tc(A), sup crc(A)) , Xj be 
the eigenvalues of A lying outside A and {cj} be the orthonormal set of 
eigenvectors corresponding to Xj . 

Assume first that y = (5a[u] , where u C T>{Qa) is an orthonormal set. 
Let di := ||nAUi||/i- and {zi} C A be a sequence with two accumulation points 
, such that Q^PamJ = df{ai Z2i-i + (1 — ca) Z2i) with some a, G [0, 1] . 
Then 

QA[Ui] = QAl^AUi] + QA['n^R\AUi] = d^^ a.; Z2i-\ ^ d\ {\ - (Xi) Z2i + ^ WijXj , 

■j 

where Wij := |(Mi,ej)/^p. Since Y^jWij = ||nR\AMi|||^ = ^~dl and Xli^ii < 
< 1, this implies that y G , where x is an arbitrary generating 
sequence containing all the eigenvalues Xj and the subsequence {zi\ . 

Assume now that y = {yi, y2, . . .} G S*^ for some generating sequence x . 
By Lemma [4. 4[ there exists an orthonormal set {fn} C Tl\H {^T>{Q a) such 
that Xn = QA[vn\ for all x„ G A . Let A be the self-adjoint operator in the 
space H such that Acj = XjCj and Avn = Xn f n for all x„ G A . In view of 
Lemma 13.61 and Theorem I3.1UI we have Qj^ [u] = y for some orthonormal set 
u = {■Ui,M2, • • •} C T>{Q^) . If di := llnAMill/^ and Zi := d'^'^Q ^\U.^Ui] then 
the sequence {zi} satisfies conditions of Lemma 14.41 Therefore Zi = QA[u'i\ 
for some orthonormal set {u'^ C li^H ^V{Qa) ■ Since A]r\a = ^r\a , the 
orthonormal set u := {diu[ + nK\A^ti} satisfies (5a[u] = y . □ 

Corollary 4.7. For each m = l,2,...,cx3 the set S(m,y4) is convex and 
exS(m, y4) C ap{m,A) . A sequence y G ap{m,A) belongs to exS(m,y4) if 
and only if there is a (possibly, degenerate) interval [fi~,fi^] C M such that 

(1) C aUA)f][-oo,fi-)=(/}, n(/i+, +oo] = ; 

(2) yf]{fi = and y contains all the eigenvalues Xj ^ [/i ,yU+] 
according to their multiplicities. 
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Proof. Let x be a generating sequence. Theorems 13.151 and I4.fil imply that 

the set S(m, A) = •S'^ ^^^ is convex and exS(m, A) = exS'^ ^.^^ C P^^i^^) ■ 

Let y G ap{m,A) and /x^ e M satisfy (1) and (2). Then y f]{—oo, fi~] 
either is empty or coincides with the union of disjoint nondecreasing subse- 
quences Yn such that supy„, < inf y„+i and supy„ ^ y„ whenever y„ is 
infinite (in the latter case A is bounded from below). Using this observation, 
one can easily show by induction in n that the sequence y f](— oo, fi~] can- 
not be represented as a convex combination of two distinct sequences from 
5*^ (.^^ . Similarly, y f][/i+, +cxd) is not a convex combination of two distinct 
sequences from S'^ . Therefore every sequence y G crp{m, A) satisfying the 
conditions of the corollary belongs to ex S'^ . 

Assume now that y G exS"^ and denote ay := {A G : A ^ y} . If 

a-^{A) ^0, a+^iA) ^0, inf < sup a", (A) and 

y, := yf|(infcr;,(A),supa-33(A)) ^ 

then y^ coincides with a convex combination of two distinct sequences yf 
whose entries lie in the open interval (inf sup (3"~g(A)) . By Lemma 

13.81 we have y^ G S^^ ^^-j , where k is the number of entries in yo and 
:= xf](inf (T+g(A),sup(T~g(y4)) . Therefore the sequence y G exS'^ ^^^ 
does not have entries which are greater than inf a^^^{A) and smaller than 
sup(T~s(A) . In particular, y f](inf (Tc(v4), sup (Tc(A)) = 0. Since the number 
of entries inf adA) and snpadA) in the generating sequence x does not 
exceed the multiplicity of the corresponding eigenvalue and y G ^^-j , this 
implies that y G o-p(m. A) . 
Let 

^- = ^+ ■= inf ais(A) if dy = and a", (A) = ; 

^- = fi+ := supa-^{A) if dy = and a^,,{A) = ; 

ji^ = := H if CTy = and inf (T+g(A) > sup(3-~g(A) , where /i is 

an arbitrary number from the closed interval [sup a^s(74), inf (j+g(y4)] ; 

yU~ := inf (Ty and /i"*" := sup cXy if Uy 7^ . 

Obviously, in the first three cases (1) and (2) hold true. It remains to prove 
that yn(/i-,/i+) = 0, ais(^)n(-oo,/i-) = and ^-.(A) n(/^+, +00) = 
in the last case. 

Let (Ty 7^ and /i^ be defined as above. If cTy contains two distinct 
entries A and yU and y has an entry Ui G (A, /i) then y coincides with 
a convex combination of two distinct sequences obtained by replacing Ui 
with A and /i respectively. Both these sequences belong to for some 

generating sequence x . Therefore the inclusion y G ex 5*^ j-^^ implies that 

yn(/i-,/U+) = 0. 

If m < 00 then (T+g(A) f](— 00, /i ) = as the number of eigenvalues lying 
below yU" is finite. Assume that m = 00 and that there exists A G a^^^{A) 
such that \ < ii~ . Let y* be a decreasing subsequence of y f](— cxd, /x^) , 
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which converges to A , and x* G be the sequence obtained from y* by 
adding an entry /i G ciy . By Lemma 13. 7[ the sequences obtained from 
y* by replacing an arbitrary entry i/i G y* with i/i — e > X and yi + e < /i~ 
respectively belong to S^, . Therefore y± ^ , where y± are the sequences 
obtained from y by replacing the entry yi with yi±e . Since y = |(y_+y+) , 
this contradicts to the inclusion y G ex • 

In a similar way one can show that a~g{A) f]{fi~^, +00) = . □ 

Remark 4.8. Let Ac{A) C M be the intersection of all intervals 
satisfying the condition (1) of Corollarv l4.7[ If the number of eigenvalues lying 
outside Ac{A) is smaller then m then, by Corollarv 14. 7[ the set E(m, A) 
does not have any extreme points. 

Definition 4.9. If x is a generating sequence of A , let Q{oo, A) := Qx ? 
Xa '■= Xq^ (see Definition 13. 5|) . Q{m,A) be the projection of Q{oo,A) on 
the subspace of Xa spanned by the first m coordinate vectors and X^'' be 
the topology on Q^'* induced by Tm(X^,X^) . 

Obviously, the symmetric perfect space Xa and its subset Q{oo,A) do 
not depend on the choice of generating sequence x . By Theorems 13.101 and 
14. 6[ we have 

(4.1) 5; C S(oo,A) C Q(oo,A) 
for each generating sequence x . 

Lemma 4.10. For every x G cr(cxD, A) and every sequence of strictly positive 
numbers Sk there exists y G S(oo,y4) such that \yk — Xk\ < Sk ■ For every 
y G S(oo,A) there exists a sequence of vectors jn G convcT(oo,A) which 
converges to y in the Mackey topology Tm(XA,X^) . 

Proof. Let A^. := {xk — £k,Xk + £k) ■ If G (Tess(^) then dimPA^-f^ = 00. 
Since a finite dimensional perturbation does not change the essential spec- 
trum, by induction in k one can find an orthonormal sequence {ui,U2, ■ ■ ■} 
such that Auk = XkUk whenever Xk ^ o"css(^) and Uk G PajH otherwise. If 
yk = QA[uk] then y G S(cx), A) and \yk - Xk\ < £k ■ 

The second statement of the lemma follows from Corollary 13.111 and the 
second inclusion ()4.H) . □ 

Lemma I4.1UI immediately implies that 

(4.2) convcr(m,A) = E(m, A) = Q{m,A), Vm = 1, 2, . . . , cx) , 

where the bar denotes the sequential closure taken in any topology which 
is finer than the topology of element-wise convergence Xq and coarser than 
X^'' . Since Tq is a metrizable topology, (j4.2p remains valid if we take the 
usual closure. 
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Corollary 4.11. For each m = 1, 2, . . . , oo the set Q{m, A) is convex and 
exQ{m,A) C (j{m,A). A sequence y G a{m,A) belongs to exQlrrijA) if 
and only if there is a (possibly, degenerate) interval C M such that 

(1) aess(^) C 

(2) yf](/i^,/i+) = and y contains all the eigenvalues \j ^ 
according to their multiplicities. 

Proof. Let x be a generating sequence, = limsupx and x~ = liminf x. 
In view of (Q, (EH) and (D, we have Q{m,A) = S": . Therefore the 
corollary is obtained by applying Corollarv 14. 71 to the operator A © A^ © A_ 
acting in the orthogonal sum H © © , where A± is multiplication by 
in H±, dimi^i = oo whenever < oo and H± = otherwise. □ 

Remark 4.12. By Corollarv 14.111 each sequence y G exQ{m, A) consists of 
eigenvalues Xj ^ conv aess{A) and, possibly, a collection of entries miaess{A) 
and sup(Tess(^)- AH these eigenvalues can be found with the use of the 
Rayleigh-Ritz variational formula. The interval Ae{A) defined in Remark 
14.81 is a subset of dessiA) and may be strictly smaller. Therefore a sequence 
y G exE(oo,y4) may contain eigenvalues lying inside conv aess{A) . 

Example 4.13. Assume that the continuous spectrum of A is empty and 
that the eigenvalues of A form a sequence x which has two accumulation 
points such that > A_ . Then conv aess{A) = [A~,A+]. However, if 
A~ or A"^ is not an accumulation point of the sequence xf][A~,A+] then 
Ae{A) = and x is an extreme point of S(cxd, A) . 

Example 4.14. If a^ssiA) = [-oo, +oo] then S(oo,A) = Q{oo,A) = M°° 
and exS(cx),A) = . If o"ess(^) = {+00} then S(oo, A) = Q{oo,A) and the 
extreme points of Ti{oo,A) are the sequences formed by all the eigenvalues 
Xj . If aess{A) = [fi, +00] , fi G (3"^s(y4) f]M. and x is the sequence formed by 
all the eigenvalues Xj < /i then every extreme point of Q{oo, A) is obtained 
from X by adding an arbitrary collection of entries fi and every extreme point 
of Ti{oo,A) is obtained from x by adding a collection of entries /i whose 
number does not exceed the multiplicity of the eigenvalue fi (we assume that 
the multiplicity is zero if fi is not an eigenvalue). 

Remark 4.15. Let be the set of all real sequences with entries in the 
interval (—00, A] . Theorem 14 .61 implies that E(cxd, A) H^a^ = E(cxo, v4(_oo,a]) 
whenever rank v4(a,+oo) = 00 . This observation allows one to extend Theorem 
Inland Corollaries gnimi to the sets S(oo,A)nK^ and (T(oo,A)nK^- 
Note that the linear space Xa^-xi may well be smaller than Xa ■ In this case 
one can refine Lemma I4.1UI and related results by considering the operator 
Ax — XI instead of A . 

4.3. Variational formulae and exposed points. Recall that a function 
: — > M defined on a convex set fl is called quasi-concave if 

(4.3) V^(ax+(l-a)y) > min{7/'(x), ^(y)} , Vx, y G fi , Va G (0, 1) , 
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and strictly quasi-concave if the left hand side of ()4.Hj) is strictly greater than 
the right hand side. The function ip is quasi-concave if and only if the sets 
{x G X : ^/'(x) > A} are convex for all A G M. The function ip is said to be 
sequentially upper T-semicontinuous if these sets are sequentially closed in 
the topology T. The identity ()4.2j) and Corollary |^7| immediately imply the 
following two variational results. 

Corollary 4.16. If ip is a quasi-concave sequentially upper -semiconti- 
nuous function on Q{m,A) then 

inf tP{x) = inf ^(x). 

For each finite m the functions V'(x) = xi -\- X2 ■ ■ ■ + Xm and 'i/'(x) = 
X1X2 ■ ■ ■ Xm = exp(lnxi + . . . Inxm) defined on the set of positive sequences 
are quasi-concave and To-upper semicontinuous. Therefore the variational 
formulae for the sum and product of the first m eigenvalues of a positive 
self-adjoint operator are particular cases of (j4.4j) . 

Corollary 4.17. Let ip be a real-valued function defined on S(m, A) . // 

(a) either ip is quasi-concave and ip{y) < ipiy) for all y ^ y 

(b) or ip is strictly quasi- concave and ip{y) < "ipiy) for all y 

then y G crp(m, A) . 

Note that y is a T-exposed point of the set S(m, A) if and only if there 
exists a linear T-continuous function ip satisfying the condition (a). 

Example 4.18. If m < 00 then Q{m,A) is a closed convex polytope, 
S(m,A) is a convex dense subset of Q{m,A) and, by Corollaries 14.71 and 
14. m we have exE(m, A) C ex(5(m, A) . In this case the extreme points of 
E(m,A) and Q{m^A) are exposed in the standard Euchdean topology. 

The sets E(cx),A) and Q{oo,A) may contain extreme points which are 
not 'Xm(XA, X^)-exposed. 

Example 4.19. If A is not bounded then Xa = and = Mg^ . For 

every y G M°° and x' G there exists y G Py such that y 7^ y and 
(y,x') = (y,x') . Therefore the sets T,{oo,A) and Q{oo,A) do not contain 
X^)-exposed points whenever A is unbounded. 

If y G exS(oo,yl) or y G exQ{(yo, A) , let be the interval intro- 

duced in CoroUarv 14.71 or [4.111 respectivelv. y(+) := y f][/i+, +00) , y(_) := 
yf]{—oo,fi~] and A^ be defined as follows: 

Ay := limsupy(+) whenever y(+) is infinite, Ay := inf y(_|_) whenever 
y(+) is finite and nonempty, and Ay := /i+ whenever y(4.) = ; 

Ay := liminfy(_) whenever y(_) is infinite. A" := supy(_) whenever 
y(_) is finite and nonempty, and Ay := /i~ whenever y(_) = . 
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If Ay < Ay , denote by Ay the interval with end points A" and Ay such 
that Ay G Ay if and only if Ay is an accumulation point of the sequence 
obtained from y by removing all the entries Uj G [Ay , Ay] . If A" = Ay , let 

Obviously, cress(^) C Ay and y contains all the eigenvalues lying outside 
the closure Ay of the interval Ay . The entries of y lying below and above 
Ay form a nondecreasing sequence y^^-* and a nonincreasing sequence y*^"*"^ 
respectively (either of these sequences may be empty). 

Theorem 4.20. // A belongs to the trace class then every extreme point 
y G exQ{oo^ A) or y & exT,{oo, A) is Irai^A, X'^^)- exposed. If A is bounded 
but does not belong to the trace class then 

y G exQ{oo, A) is a %^{Xa, X'^)-exposed point of Q{oo,A) if and 
only if either y Ay = or Ay consists of one point; 
y G exTi{oo, A) is a %j^{Xa, X'^)-exposed point of S(oo,A) if and 
only if either y Ay = or Ay is closed and the spectrum of the 
truncation A^y consists of one point. 

Proof. Assume that y G Q{c!C,A) or y G exS(oo,A) and y G S(oo,A) C 
Q{oo, A) . Let i/jj < < ■ ■ ■ be the entries of y*^"^ , > l/fca > • • • be the 
entries of y^+^ and , ?/„2 5 • • • be the entries of y lying in Ay. Consider 
an arbitrary sequence x' G such that 

x;.^ < x;.^ < . . . < , x'j,^>x[^> ...>0 and x'^^ = x'^^ = . . . = . 

The identity ()1.6p implies that yj- x'j_ > ^ . yj. x'j. and these two sums 
coincide only if yj^ = yj^ for all i . Similarly, J2i ^'j, > J2i x'^^ and the 
sums coincide only if y^. = y^. for all i . If Ay satisfies the conditions of the 
theorem, yj. = yj. for all i and y^- = for all i then, in view of Theorem 
14.61 we have y = y . Therefore the sequence y is Tm(-^A, -^A)"6xposed. 
If y G and 

■^ii ^ "^j^ < • • • < ~2 , > > . . . > 2 , = = . . . = 1 

then the same arguments show that (y,x') > (y,x') for all y G Q{c)0,A) . 
This proves the first statement of the theorem. 

Assume now that A does not belong to the trace class and that y is 
%rn{XA, X'j^)-exposed. Then there exists a sequence x' G X'^ C such 
that (y,x') > (y,x') whenever y & Py and y 7^ y . If yi > yj but x[ < x'j 
then (y, x') < (y, x') , where y G Py is the sequence obtained from y by 
interchanging the entries and yj . Therefore 

(C2) Xi> x'j whenever yi > yj . 

If Ay = Ay then Ay satisfies the conditions of the theorem. Assume that 
Ay < Ay . Then Ay are accumulation points of y and A is not closed if and 
only if y contains infinitely many entries A" or Ay . The inclusion x' G 
and (C2) imply that Xj = whenever ?/j G Ay . If y has two distinct entries 
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in Ay then (y, x') = (y, x') , where y 7^ y is the sequence obtained by 
interchanging these entries. Therefore either y Ay = or there exists A 
such that Hi = X whenever ?/j G Ay . If yf] Ay 7^ and a{Aiy^) contains 
another point /i 7^ A then we can find u G Yl\^\^^]H such that A := 7^ A 

and the sequence y obtained by replacing A with A belongs to S(oo,A). 
Since (y,x') = (y,x'), we see that ai^Ap^^) = {A} whenever yP|Ay 7^ 0. 
Finally, if y G Q{oo,A) or Ay is not closed then (y,x') = (y,x') for the 
sequence y obtained by replacing A with A" or Ay . Therefore in either 
case y n Ay = . □ 

4.4. Family of operators. Finally, let us consider a family of self-adjoint 
operators {Agjege acting in H , where B is an arbitrary index set. The 
following corollary implies that 

(4.5) cr{oo,A) C coHV IJ cr(cx), Ae) 

whenever A G conv {Aq} , provided that the closures are taken in appropriate 
topologies. 

Corollary 4.21. Let X be a subspace of M°° and A be a self-adjoint op- 
erator in H such that C X and X^g C X for all 9 E Q . Assume 
that for every orthonormal set u C T>{Qa) , every x' G X' and every e > 
there exist an operator Aq and an orthonormal set u C V{QAg) such that 
{Qa[u],^') < {QAg[u], x') . Then we have (j4.5|) . where the closure is taken 
in the Mackey topology Tm(X, X') . 

Proof. By the separation theorem, under conditions of the corollary we have 
S(oo, A) C conv UggQ S(oo, Ae) . Therefore (g^l) follows from (jO))- □ 

In Corollary 14.211 we can always take X = M°° , in which case X' = M."^ 
and Tm(X, X') coincides with the topology of element-wise convergence Tq . 
If A and Ag satisfy the conditions of Corollarv 14.211 and are compact then 
we can take X = , which implies (|4.5p with the closure taken in the 
/°°-topology. 
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